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SARD PROPERTY FOR THE ENDPOINT MAP ON SOME 

CARNOT GROUPS 

ENRICO LE DONNE, RICHARD MONTGOMERY, ALESSANDRO OTTAZZI, 
PIERRE PANSU, AND DAVIDE VITTONE 


Abstract. In Carnot-Caratheodory or sub-Riemannian geometry, one of the ma¬ 
jor open problems is whether the conclusions of Sard’s theorem holds for the end¬ 
point map, a canonical map from an infinite-dimensional path space to the under¬ 
lying finite-dimensional manifold. The set of critical values for the endpoint map 
is also known as abnormal set, being the set of endpoints of abnormal extremals 
leaving the base point. We prove that a strong version of Sard’s property holds 
for all step-2 Carnot groups and several other classes of Lie groups endowed with 
left-invariant distributions. Namely, we prove that the abnormal set lies in a proper 
analytic subvariety. In doing so we examine several characterizations of the abnor¬ 
mal set in the case of Lie groups. 
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1. Introduction 


Let G be a connected Lie group with Lie algebra g. Let V C g be a subspace. 
Following Gromov |Gro96l Sec. 0.1], we shall call the pair (G, V) a polarized group. 
Carnot groups are examples of polarized groups where V is the first layer of their 
stratification. To any polarized group (G, V ) one associates the endpoint map: 

End : L 2 ([0,1], V) —> G 

u ha 7 U ( 1 ), 


where is the curve on G leaving from the origin e G G with derivative (d L 1 ^) e u{t). 

The abnormal set of (G, V ) is the subset Abn(e) C G of all singular values of 
the endpoint map. Equivalently, Abn(e) is the union of all abnormal curves passing 
through the origin (see Section 1231) . If the abnormal set has measure 0, then (G, V) is 
said to satisfy the Sard Property. Proving the Sard Property in the general context of 
polarized manifolds is one of the major open problems in sub-Riemannian geometry, 
see the questions in [Mon02l Sec. 10.2] and Problem III in Agrl3 . In this paper, 


we will focus on the following stronger versions of Sard’s property in the context of 
groups. 
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Definition 1.1 (Algebraic and Analytic Sard Property). We say that a polarized 
group (G, V) satisfies the Algebraic (respectively, Analytic ) Sard Property if its ab¬ 
normal set Abn(e) is contained in a proper real algebraic (respectively, analytic) 
subvariety of G. 

Our main results are summarized by: 

Theorem 1.2. The following Carnot groups satisfy the Algebraic Sard Property: 

(1) Carnot groups of step 2; 

(2) The free-nilpotent group of rank 3 and step 3; 

(3) The free-nilpotent group of rank 2 and step 4; 

(4) The nilpotent part of the Iwasawa decomposition of any semisimple Lie group 
equipped with the distribution defined by the sum of the simple root spaces. 

The following polarized groups satisfy the Analytic Sard Property: 

(5) Split semisimple Lie groups equipped with the distribution given by the subspace 
of the Cartan decomposition with negative eigenvalue. 

(6) Split semisimple Lie groups equipped with the distribution defined by the sum 
of the nonzero root spaces. 

Earlier work jMon94] allows us 

(7) compact semisimple Lie groups equipped with the distribution defined by the 
sum of the nonzero root spaces, (i.e., the orthogonal to the maximal torus 
relative to a bi-invariant metric). 

Case (1) will be proved reducing the problem to the case of a smooth map between 
finite-dimensional manifolds and applying the classical Sard Theorem to this map. 
The proof will crucially use the fact that in a Carnot group of step 2 each abnormal 
curve is contained in a proper subgroup. This latter property may fail for step 3, 
see Section m However, a similar strategy together with the notion of abnormal 
varieties , see (I 2 . 2 ip . might yield a proof of Sard Property for general Carnot groups. 

The proof of cases (2)-( 6 ) is based on the observation that, if A is a family of 
contact vector fields (meaning infinitesimal symmetries of the distribution) vanishing 
at the identity, then for any horizontal curve 7 leaving from the origin with control u 
we have 

(.R 7 (i))*H + (L 7 ( 1 ))*V + A(y(l)) C Im(dEnd u ) C T 7 ^G. 

Therefore if g G G is such that 

(1.3) (R g )*V + {L g )*V + X(g) = T g G , 

then g is not a singular value of the endpoint map. In fact, if (j 1.3 [) is describable as 
a non-trivial system of polynomial inequations for g, then (G, V) has the Algebraic 
Sard Property. Case (3) was already proved in |LDLMV14j by using an equivalent 
technique. 
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Equation (11.31) does not have solutions in the following cases: free-nilpotent groups 
of rank 2 and step > 5, free-nilpotent groups of rank 3 and step > 4, free-nilpotent 
groups of rank > 4 and step > 3. Here Sard’s property remains an open problem. 

We further provide a more quantitative version of Sard’s property for free-nilpotent 
groups of step 2. 

Theorem 1.4. In any free-nilpotent group of step 2 the abnormal set is contained in 
an affine algebraic subvariety of codimension 3. 

Agrachev, Lerario, and Gentile previously proved that in a generic Carnot group of 
step 2 the generic point in the second layer is not in the abnormal set, see [AGL131 
Theorem 9]. 

There are several papers that give a bound on the size of the set of all those 
points End('u) where u is a critical point with the extra property that is length 
minimizing for a fixed sub-Riemannian structure. A very general result |Agr09| by 
Agrachev based on techniques of Rifford and Trelat | RT05j states that this set is 
contained in a closed nowhere dense set, for general sub-Riemannian manifolds. 

In this direction, in step 3 Carnot groups equipped with a sub-Riemannian structure 
on the first layer, we bound the size of the set Abn im (e) of points connected to the 
origin by locally length minimizing abnormal curves. Our result uses ideas of Tan and 
Yang (TY131 and the fact that in an arbitrary polarized Lie group the Sard Property 
holds for normal-abnormal curves, see Lemma [2.321 

Theorem 1.5. Let G be a sub-Riemannian Carnot group of step 3. The Sub-analytic 
Sard Property holds for locally length minimizing abnormal curves. Namely, the set 
Abn im (e) is contained in a sub-analytic set of codimension at least 1. 

The paper is organized as follows. Section 2 is a preliminary section. First we 
recall the definition of the endpoint map and we give a characterization of the image 
of its differential in Proposition 12.31 in the case of polarized groups. Secondly, we 
review Carnot groups, abnormal curves, and give interpretations of the abnormal 
equations using left-invariant forms and right-invariant forms. In Section 12.51 we 
examine the notion of abnormal varieties. In Section 12.71 we review normal curves, 
and in Section 12.81 we review the Goh condition. In Section [3] we consider step- 
2 Carnot groups. We first prove the Algebraic Sard Property for general Carnot 
groups of step 2 and then we prove Theorem 11.41 for free step-2 groups. For the 
latter, we also give precise characterizations of the abnormal set. In Section []] we 
discuss sufficient conditions for Sard’s property to hold. In particular, we discuss 
the role of contact vector fields and equation (11.31) . The most important criteria are 
Proposition 14.111 and Corollary 14.141 which will be used in Section [5] to prove the 
remaining part of Theorem 11.21 In Section 15.31 we discuss Sard Property for a large 
class of semidirect products of polarized groups. In particular, we provide examples 
of groups with exponential growth having the Analytic Sard Property (semisimple Lie 
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groups) and the Algebraic Sard Property (solvable Lie groups). See Proposition 15.51 
and Remark PTTTTl Section |H] is devoted to Carnot groups of step 3. First we prove Sard 
Property for abnormal length minimizers, i.e., Theorem 11.51 Second, we investigate 
the example of the free 3-step rank-3 Carnot group, showing that the argument used 
in step -2 Carnot groups finds an obstruction: there are abnormal curves not contained 
in any proper subgroup. We conclude the article with Section [Tj where we discuss 
the open problems. 

Acknowledgments Most of the work in this paper was developed while the authors 
were guests of the program Geometry, Analysis and Dynamics on Sub-Riemannian 
Manifolds at the Institut Henri Poincare in the Fall 2014. The authors are very 
grateful to the program organizers A. Agrachev, D. Barilari, U. Boscain, Y. Chitour, 
F. Jean, L. Rifford, and M. Sigalotti, as well to 1HP for its support. 

2. Preliminaries 

Let G be a connected Lie group with Lie algebra g, viewed as the tangent space of 
G at the identity element e. For all g G G, denote by L g and R g the left and right 
multiplication by g, respectively. Also, Ad s := d (L g o R g - i) e . 

Fix a linear subspace V C g. Let u be an element of L 2 ([0,1], V). Denote by 
the curve in G that solves the ODE: 

( 2 . 1 ) Lj() = (dL T( 1 ,) e <«M, 

with initial condition y(0) = e. Viceversa, if 7 : [0,1] —> G is an absolutely continuous 
curve that solves (12.11) for some u G L 2 ([0,1],E), then we say that 7 is horizontal 
with respect to V and that u = is its control. In other words, the derivatives of 7 
lie in the left-invariant subbundle, denoted by A, that coincides with V at e. 

The endpoint map starting at e with controls in V is the map 

End : L 2 ([0,1], V) -7- G 

u H 7 7 „( 1 ). 

2.1. Differential of the endpoint map. The following result is standard and a 
proof of it can be found (in the more general context of Carnot-Caratheodory mani¬ 
folds) in |Mon02[ Proposition 5.2.5, see also Appendix E], 

Theorem 2.2 (Differential of End). The endpoint map End is a smooth map between 
the Hilbert space L 2 ([0,1], V) and G. If 7 is a horizontal curve leaving from the origin 
with control u, then the differential of End at u, which is a map from L 2 ([0,1], V) to 
the tangent space of G at 7 ( 1 ), is given by 

dEnd u u = (di? 7 (i)) e f Ad 7 ( t) v(t) dt, Vu G L 2 ([0,1], V). 

J 0 
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Sketch of the proof. The proof of a more general result can be found in [Mon02j . We 
sketch here the simple proof of the formula in the case when G C GL n (W. ), where we 
can interpret the Lie product as a matrix product and work in the matrix coordinates. 
Let 7 u+ev be the curve with the control u + ev and a(t) be the derivative of 7 u +ev(f) 
with respect to e at e = 0. Then a satisfies the following ODE (which is the derivation 
with respect to e of ( 12 .ip for 7 U+£V ) 

= 7 (t) ■ v(t) + a ■ u(t). 

Now it is easy to see that /g Ad 7 ( s j(r(s)) ds • 7 (f) satisfies the above equation with 
the same initial condition as a, hence is equal to a. □ 

Proposition 2.3 (Image of dEnd). If 7 : [0,1] —>■ G is a horizontal curve leaving 
from the origin with control u, then 

(2.4) Im(dEnd u ) = (di? 7 (i)) e (span{Ad 7 ( t ) P : fG [0,1]}). 

Proof. A glance at the formula of Theorem 12.21 combined with the fact that (di? 7 ( i)) e 
is a linear isomorphism from g to T^^G shows that it suffices to prove that 

Ad 7 (q v(t) dt : v G L 2 ([ 0,1], H) j = span{Ad 7 ( t) V : i G [0,1]}. 

C: Any linear combination of terms Ad 7 ( t p Vi is in the right hand set. Now an 
integral is a limit of finite sums and the right hand side is closed. Hence the right 
hand side contains the left hand side. 

D: It suffices to show that any element of the form f = Ad 7 ( tl ) V\ lies in the left hand 
side. Let 'f n {t) be a delta-function family centered at t\, that is, a smooth family 
of continuous functions for which the limit as a distribution as n —> 00 of 'f n (t) is 
8(t — ti). Then lim^,*, /q 1 Ad 7 ( f ) f> n (t)vi d t = Ad 7 (j 1 ) v x = f and since the left hand 
side is a closed subspace, £ lies in the set in the left hand side. □ 

Remark 2.5. Evaluating (12.4p at t — 0 and t = 1 yields 

(2.6) (di? 7 (i)) e P + (dL 7 ( i)) e H C Im(dEnd u ). 

Remark 2.7. Proposition 12.31 implies immediately that for strongly bracket generating 
distributions, the endpoint map is a submersion at every u 0. We recall that a 
polarized group (G, V) is strongly bracket generating if for every A" 6 V \ {0}, one 
has V + [X, V] — g. 

Remark 2.8 (Goh’s condition is automatic in rank 2). Assume that dimH = 2. We 
claim that if 7 is horizontal leaving from the origin with control u, then for all t G [0,1] 
we have 


(2.9) 


(dAA,(i)[V,V] C Im(dEnd u ). 
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Indeed, we may assume that 7 is parametrized by arc length and that t is a point of 
differentiability. Hence, 7 (t) _ 1 7 (t + e) = exp (u(t)e + o(e)). Notice that since u{t) G 
H\{0} and dim V — 2, it follows that [u(t), V] = ['V , V], Therefore Ad“^ Ad 7 (j +e ) V = 
e ad u (t) £ + 0 (oH. Hence, for all Y G V 

e[u(t), V ] + o(e) G H + Ad 7 ^ Ad 7 (t +e ) V. 

Therefore, Proposition 12. dl implies that Ad 7 q) [■»,(£). Y] G (d i? 7 (i))“ 1 Im(d End u ), which 
proves the claim. 

By (12.35ft below, formula (12. 9 p implies that, whenever 7 is an abnormal curve (see 
Section [273]) in a polarized group (G, V) of rank 2, then 7 satisfies the Goh condition 
(see Section 12.81) . 

Remark 2.10 (Action of contact maps). We associate to the subspace V C g a left- 
invariant subbundle A of TG such that A e = V. A vector field £ G Vec(G) is said to 
be contact if its flow preserves A. Denote by 

5 := {£ G Vec(G) | £ contact, £ e = 0} 

the space of global contact vector fields on G that vanish at the identity. We claim 
that, for every horizontal curve 7 leaving from the origin, 

(2.11) 5 ( 7 ( 1 )) Clm(dEnd u ). 

Indeed, let £ G S and let be the corresponding flow at time s. Since £ e = 0, we 
have that 0|(e) = e. Consider the curve 7 s := o 7 . Notice that 7 s (e) = e and that 
7 s is horizontal, because £ is a contact vector field. Therefore, 

End(n s ) = 7 s (l) = ^(7(l)), 

where u s is the control of 7 s . Differentiating at s = 0, we conclude that £( 7 ( 1 )), 
which is an arbitrary point in 5 ( 7 ( 1 )), belongs to Im(dEnd u ). 

2.2. Carnot groups. Among the polarized groups, Carnot groups are the most dis¬ 
tinguished. A Carnot group is a simply connected, polarized Lie group (G, V ) whose 
Lie algebra g admits a direct sum decomposition in nontrivial vector subspaces 

0 = Vl © V 2 ® ... ® V s such that [t£, V)] = V i+j 
where 14 = {0}, k > s and V\ = V. We refer to the ith summand 14 as the ith layer. 

The above decomposition is also called the stratification of 0 and Carnot groups 
are often referred to in the analysis literature as stratified groups. The step of a 
Carnot group is the total number s of layers and equals the degree of nilpotency of 
0 : all Lie brackets of length greater than s vanish. Every Carnot group admits at 
least a canonical outer automorphism, the ‘scaling’ 5\ which on 0 is equal to the 
multiplication by A* on the ith layer. 

Since G is simply connected and nilpotent, the exponential map exp : 0 —y G is a 
diffeomorphism. We write log for the inverse of exp. When we use log to identify 0 
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with G the group law on G becomes a polynomial map g x g A g with 0 G g playing 
the role of the identity element e £ G. 

2.3. Abnormal curves. 

Definition 2.12 (Abnormal curve). Let (G, V ) be a polarized group. Let 7 : [0,1] 

G be a horizontal curve leaving from the origin with control u. If Im(d End,,) C T^/uG, 
we say that 7 is abnormal. 

In other words, 7 is abnormal if and only if 7(1) is a critical value of End. We 
define the abnormal set of (G, V) as 

(2.13) Abn(e) := {7(1) | 7 abnormal ,7(0) = e} = {critical values of End}. 

The Sard Problem in sub-Riemannian geometry is the study of the above abnormal 
set. More information can be found in [Mon02i page 182], 

Interpretation of abnormal equations via right-invariant forms. Proposition 12.31 gives 
an interpretation for a curve to be abnormal, which, to the best of our knowledge, is 
not in the literature. 

Corollary 2.14. Let (G, V ) be a polarized group and let 7 : [0,1] —* G be a horizontal 
curve. Then the following are equivalent: 

( 1 ) 7 is abnormal; 

(2) there exists A € g* \ {0} such that A(Ad 7 ( t ) V) = {0} for every t £ [0,1]; 

(3) there exists a right-invariant 1-form a on G such that a( A 7 (q) = {0} for 
every t £ [0,1], where A is the left-invariant distribution induced by V. 

Proof. (2) and (3) are obviously equivalent. By Proposition 12.31 7 is abnormal if and 
only if there is a proper subspace of g that contains Ad 7 (t) V for all t. □ 

Interpretation of abnormal equations via left-invariant adjoint equations. The pre¬ 
vious section characterized singular curves for a left-invariant distribution on a Lie 
group G in terms of right-invariant one-forms. This section characterizes the same 
curves in terms of left-invariant one-forms. This left-invariant characterization is the 
one used in |Mon94[ Equations (12), (13) and (14)] and [ GK95i equations in Sec¬ 
tion 2.3]. We establish the equivalence of the two characterizations directly using 
Lie theory. Then we take a second, Hamiltonian, perspective on the equivalence of 
characterizations. In this perspective, the right-invariant characterization is simply 
the momentum map applied to the Hamiltonian provided by the Maximum Principle. 

We shall also introduce the notation 

(2.15) w{rj){X, Y) := V ([X, Y ]) , for 77 G V 1 C 0 *, X, Y £ V. 

Proposition 2.16. Let (G,V) be a polarized group and let 7 : [0,1] —> G be a 
horizontal curve with control u. Then the following are equivalent: 
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(1) 7 is abnormal; 

( 2 ) there exists a curve q : [ 0 , 1 ] —> 0 *, with rj(t)\v = 0 and rj(t ) G 0 , for all 
t G [0,1], representing a curve of left-invariant one-forms, such that 

{ £?(*) = (ad 
\ u(t) G Kei(w(r](t))). 

Remark 2.17. There is a sign difference between the first equation of (2) above, 
namely = (&d u ( t ))*rj(t), and the analogous equation in |Mon94i Sec. 4] that 

reads § 2 (t) = - ad* u{t) 77 (f). The equations coincide if we set ad* = — (ad u )*. To 
understand this minus sign, we first observe that in the equation above (ad u )* is the 
operator (ad u )* : 0 * —> 0 * dual to the adjoint operator, so that 

((ad u )*A)(X) = A(ad u (X)) = A([u,X]). 

In the equation of |Mon941 Sec. 4] the operator ad* is the differential of the co-adjoint 
action Ad* : G —> gl($*) taken at g = e in the direction u G 0 . The minus sign arises 
out of the inverse needed to make the action a left action: Ad* (g) = (Ad 9 -i)*. 

Gole and Karidi made good use of the coordinate version of the previous propo¬ 
sition. See |GK951 page 540], following |Mon941 Sec. 4], See also |LDLMV13 
1LDLMV14] . To describe their version, fix a basis Xi,, X n of 0 such that AG,..., X r 
is a basis of V. Let c- be the structure constant of 0 with respect to this basis, seen 
as /e/t-invariant vector fields. Let (77, ... ,u r ) G V be controls relative to this basis. 
Let r]i = 77 (AQ) denote the linear coordinates of a covector 7 / G 0 * relative to this basis. 

Proposition 2.18. Let (G, V ) be a polarized group. Let 7 : [0,1] —* G be a horizontal 
curve with control Yffi=i u i (t)Xi. Under the above coordinate conventions, the following 
are equivalent: 

(1) 7 is abnormal; 

( 2 ) there exists a vector function ( 0 , 0 ,..., 0 , 77 ^+ 1 ,..., r] n ) : [ 0 , 1 ] —> M n , never 
vanishing, such that 

{ 7i7 W + Ej =1 ELr+i <$jUj(t)ri k (t) =0, for all i = r + 1,, n, 

1 E r j=i Ek=r +1 CijUjitjvkit) = 0 , for alii = 1 ,..., r. 

Both Corollary 12.141 and Proposition 12.161 lead to a one-form A(f) G Tf^G along 
the curve 7 in G. The key to the equivalence of the right and left perspectives of these 
two propositions is that these one-forms along 7 are equal. For the right-invariant 
version, Corollary 12.141 provides first the constant covector X R G 0* = TfG, and then 
its right -invariant extension. Finally we evaluate this extension along 7. For the 
left-invariant version, following Proposition 12.161 we take the curve of covectors r](t), 
consider their /e/^-invariant extensions, say g{t) L (leading to a curve of left-invariant 
one-forms) and finally we evaluate 7 ](t) L at 7 (t). The following lemma establishes 
that the forms obtained in these two different ways coincide along 7. 
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Lemma 2.19. Let 7 (t) be the curve in G starting at e and having control u(t). Let 
X[t) be a one-form defined along 7 . Let A R (t) = (Pyq)*A(t) G 0 * be this one-form 
viewed by right-trivializing T*G. Let rj(t) = (L 7 ( t ))*X(t) G g* be this same one-form 
viewed by left-trivializing T*G. Then A R (t) is constant if and only if git) solves the 
time-dependent linear differential equation dg/dt = ( a,d u g))*g(t) with initial condition 
7(0) = A(0). 

Proof. Suppose that A R (t) is constant: A R (t) = X R . Set g = 7 (t). Then A (t) = 
(Rg 1 )*X R and consequently rj(t) = (LgYiRf 1 )*X R = ( Ad g )*X R . For small At we write 
7 (t + At) = 7 (t)( 7 (t)^ 1 7 (t + At)) = gh with h = h(At) = 7 (t) _ 1 7 (t + At) and use 
(Ad g hj* = (Ad/ l )*(Ad 9 )* to establish the identity for the difference quotient: 

^( 7 (t + At) - 1 fit)) = ^((Ad HAt) )* - Id)g(t). 

Now we use that the derivative of the adjoint representation h ha Ad^ evaluated at 
the identity, is the standard adjoint representation g -A gt(g) , A" -A adx = [A,-]. 
Taking duals, we see that the difference quotient ^-((Ad^At))* — Id) limits to the 
linear operator (ad n ( t ))* on g*. 

The steps just taken are reversed with little pain, showing the equivalence. □ 


2.4. Hamiltonian formalism and reduction. We describe the Hamiltonian per¬ 
spective on Corollary 12.141 Proposition 12.161 and the relation between them. 

We continue with the basis A f of left-invariant vector fields on G, labelled so that 
the first r form a basis of V. Write P* : T*Q -A M for the same fields, but viewed as 
fiber-linear functions on the cotangent bundle of G: 


( 2 . 20 ) 


P i :T*G^R;P i (g,p)=p(X i (g)). 


Given a choice of controls ufit), a = l,2...,r not all identically zero, form the 
Hamiltonian 

r 

H u {g,pfi) = J 2 u *( t )P a {g,p)- 

i —1 

The Maximum Principle [AS041 Theorem 12.1] asserts that a curve 7 in G is singular 
for V if and only if when we take its control u, and form the Hamiltonian H u , then 
the corresponding Hamilton’s equations have a nonzero solution ((t) = (g(t),p(t)) 
that lies on the variety P a — 0, a — 1, 2,..., r. Here ‘Nonzero’ means that p(t) 0, 
for all t. The conditions P a = 0 mean that the solution lies in the annihilator of 
the distribution defined by V. The first of Hamilton’s equations, implies that 7 has 
control u, so that the solution ( does project onto 7 via the cotangent projection 
Ti : T*G -A G. 


The following two facts regarding symplectic geometry and Hamilton’s equations 
allow us to immediately derive the Gole-Karidi form of the equations as expressed 
in Proposition 12.181 Fact 1. Hamilton’s equations are equivalent to their ‘Poisson 
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form’ / = Here / is an arbitrary smooth function on phase space, / = 

df(X H ) is the derivative of / along the Hamiltonian vector held Xu for //, and 
{f,g} is the Poisson bracket associated to the canonical symplectic form co, so that 
{f,g} = u(Xf,X g ). Fact 2. If X is any vector held on G (invariant or not), and 
if P x '■ T*Q —y R denotes the corresponding hber-linear function defined by X as 
above, then {P X ,P Y } = ~P[x,y]- 

Proof of Proposition 12.181 from the Maximum Principle. Take the / = P % 

and use, from Fact 2, that { P t , P 3 } = —J2 c ijPk- The Pi are equal to the ry of the 
proposition. 

Proposition 12.181 is just the coordinate form of Proposition 12.161 so we have also 
proved Proposition 12.161 

Proof of Corollary 12.141 from the Maximum principle. 

Let 7(£) be a singular extremal leaving the identity with control u = {u\,... ,u r ). 
Let H u be the time-dependent Hamiltonian generating the one-form £(£) along 7 as 
per the Maximum Principle. Since each of the Pi are left-invariant, so is H u . Now 
any left-invariant Hamiltonian H u on the cotangent bundle of a Lie group admits n = 
dirn(G) ‘constants’ of motion - these being the n components of the momentum map 
J : T*G — > g* for the action of G on itself by left translation. Recall that a ‘constant of 
the motion’ is a vector function that is constant along all the solutions to Hamilton’s 
equations. Different solutions may have different constants. The momentum map in 
this situation is well-known to equal ng/h-trivialization: T*G —> G x 0* composed 
with projection onto the second factor. In other words, if ((t) is any solution for 
H u , then = A = const and also J(C(f)) = dNow, our p(t) must 

annihilate 14, 7). The fact that p(t) equals A, right-translated along 7, and that A 7 ( t ) 
equals to V — A e , left-translated along 7 implies that A(Ad 7 m V) = 0. We have 
established the claim. □ 

2.5. Abnormal varieties and connection with extremal polynomials. The 

opportunity of considering the right-invariant trivialization of T*G , hence arriv¬ 
ing to Corollary 12.141 was suggested by the results of the two papers |LDLMV13 
ILDLMVT4 ]. where abnormal curves were characterized as those horizontal curves 
lying in specific algebraic varieties. 

Given A G 0* \ {0} we set 

(2.21) Z x -.= {geG : ((Ad 3 )*A), y = 0}. 

In every Lie group the set Z x is a proper real analytic variety. If G is a nilpotent 
group, then Z x is a proper real algebraic variety, which we call abnormal variety. 

Proposition 2.22 (Restatement of Corollary 12.141) . A horizontal curve 7 is abnormal 
if and only if 7 is contained in Z x for some nonzero A G 0*. 
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We now prove that, in the context of Carnot groups, the algebraic varieties Z x 
coincide with the varieties introduced in the papers [ LDLMVI3 , 1LDLMV14] . This 
will follow from Proposition 12.231 below. 

Let ei,..., e n be a basis of g such that ei,... ,e r is a basis of V. Let Ah denote the 
extension of e* as a left-invariant vector held on G. Let c^- be the structure constants 
of g in this basis, i.e., 

IXu X,] = •£ c%X k . 

k 

For A G g*, set 

P x (g) := ((Ad g )*A)(e*). 

Thus Z x is the set of common zeros of the functions P x , i = 1,... , r. When G is 
nilpotent, these functions are polynomials. 

Proposition 2.23. Let Y rn denote the extension of e m as a right-invariant vector 
field on G. Let ef ,..., e* denote the basis vectors of g* dual to e l7 ..., e n . For all 
i,j = 1,..., n, we have 

(2.24) ^ = E P f ny m - 

m 

Moreover, the functions P x satisfy P x (e) = Mcfi and 

n 

(2.25) X,P x = E > Vf,j = 1,... ,n, A G g*. 

k =1 

In particular, in the setting of Carnot groups the functions P x coincide with the 
extremal polynomials introduced in [LDLMV131.1LDLMV14] . 

Proof. We verify 02.241) by 

Y, P i m (g) Y M = E( Ad 9)*(4J(eO(Ag)*e m = J2 e *m( Ad g( e i))( R g)* e m 
mm m 

= (Ag)* e m (Adg(ej))e m = (A^)* Ad^(ej) = (Lg)*ej = Xfigfi 

in 

Next, on the one hand, since [Ah, Yf\ =0, 

[W,Ah] =E(A UPf m )Y m . 

m 

On the other hand, from 02.241) 

[Ah, Ah] = E4^ = E(E4n e -)^- 

k m k 

Thus 

X t Pf m = E 4 P fc"‘ > Vi,j,m = l,...,n. 

k 
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Formula (12.25ft follows because, by definition, the functions P x are linear in A. 

The extremal polynomials (PJ)j=f", jn were introduced in [ LDLMV13 . 1LDLMV14] in 
the setting of Carnot groups; they were explicitly defined in a system of exponential 
coordinates of the second type associated to a basis of g that is adapted to the 
stratification of g, see Section 12.21 Here, adapted simply means that the fixed basis 
ei,... ,e n of g consists of an (ordered) enumeration of a basis of the first layer Vi, 
followed by a basis of the second layer V2, etc. It was proved in }LDLMVT4] that the 
extremal polynomials satisfy 

n 

PJ (e) = Vj and X t PJ = J2 c-jPJ Vi,j = l,...,n,Vr 6 M n . 

k =1 

We need to check that, for any fixed v e M n , the equality PJ = P x holds for A := 
J2m v me* n - Indeed, the differences Qj := PJ — Pj satisfy 

n 

Qj (e) = 0 and X { Qj = J2 ^jQk V i, j = 1,..., n. 

k =1 

In particular, XiQ n = 0 for any i because, by the stratification assumption, c^ n = 0 
for any i, k. This implies that Q n is constant, i.e., that Q n = 0. We can then reason 
by reverse induction on j and assume that Q k = 0 for any k > j + 1; then, using the 
fact that cj = 0 whenever k < j (because the basis is adapted to the stratification), 
we have 

n 

Qj(e) = 0 and X % Q 2 = cjQ k = 0 V i — 1,..., n. 

k=j +1 

Hence also Qj = 0. This proves that PJ = Pj, as desired. □ 


Remark 2.26. In the study of Carnot groups of step 2 and step 3, it will be used 
that the varieties W x defined below (which coincide with the abnormal varieties in 
the step-2 case) are subgroups. Namely, if G is a Carnot group of step s and highest 
layer V s , and A 6 g*, then the variety 

(2.27) W x -{seS: ((Ad„)*A)| V ._, = 0} 

is a subgroup, whenever it contains the origin. Indeed, if X e g and Y e W_i, then 
(Ad. xpro )*A(y) = (e adx )*A(y) = A(Y + [X.Y]). 

Hence, in exponential coordinates the set W x is 

{X eg: A (Y + [X, Y]) = 0, VF G V^} 
and, if it contains the origin, it is 

{xeg -. A([x,y]) = o,vr ev^}. 

Since the condition A([X, F]) = 0, for all Y e W_i, is linear in A", we conclude that 
W x is a subgroup. 
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2.6. Lifts of abnormal curves. 


Proposition 2.28 (Lifts of abnormal is abnormal). Let 7 : [ 0 , 1] —> G be a horizontal 
curve with respect to V C 0. If there exists a Lie group H and a surjective homomor¬ 
phism Ti : G —y H for which n o 7 is abnormal with respect to some W D d7r e (P), 
then 7 is abnormal. 


Proof. Let End' and End" be the respective endpoint maps, as in the diagram below. 
For u G L 2 ([0,1], V) let tt*u := d7r e o u, which is an element in L 2 ([0,1], IE), because 
d7r e (E) C W. Since n is a group homomorphism, one can easily check that the 
following diagram commutes: 


L 2 ([0,1], V) -—-► G 


7r+ 

L\[0,1} : W) 


End w 


H. 


By assumption n is surjective and so is d7r s , for all g G G. We conclude that d End'" u 
is surjective, whenever d End" is surjective. □ 

Example 2.29 (Abnormal curves in a product). Let G and H be two Lie groups. 
Let V C Lie(Cr) and W C Li e(H). Assume that W 7^ Li e(H). Let 7 : [0,1] —» G x H 
be a curve. If 7 = (71 (t), e) with 7! : [0,1] —* G horizontal with respect to V, then 7 
is abnormal with respect to V x W. Indeed, this fact is an immediate consequence 
of Proposition 12.281 using the projection G x H —>• H and the fact that the constant 
curve in H is abnormal with respect to the proper subspace W. 


Remark 2.30. Let G and H be two Lie groups. If 71 : [0,1] G is not abnormal 
with respect to some V C Lie(G) and 72 : [0,1] —* H is not abnormal with respect 
to some W C Lie (if), then (71,72) : [0,1] —* G x H is not abnormal with respect to 
V x W. 


Example 2.31 (H x H ). Let H be the Heisenberg group equipped with its contact 
structure. By Example 12.291 and Remark 12.301 the abnormal curves leaving from the 
origin in H x H are the curves of the form (q(t), e) or (e, 7 (£)), where 7 : [0,1] —» H 
is any horizontal curve. In particular, Abn(e) = H x {e} U {e} x H , which has 
codimension 3. 


2.7. Normal curves. Let (G, V ) be a polarized group such that V is bracket generat¬ 
ing. Equipping V with a scalar product || • || 2 , we get a left-invariant sub-Riemannian 
structure on G. Recall that from Pontrjagin Maximum Principle any curve that 
is length minimizing with respect to the sub-Riemannian distance is either abnor¬ 
mal, or normal (in the sense that we now recall), or both normal and abnormal. A 
curve 7 with control u is normal if there exist Ao 7^ 0 and Ai G T*^G such that 
(Aq,Ai) vanishes on the image of the differential at u of the extended endpoint map 
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End : L 2 ([0,1],R) —* R x G, v H > (||u||2, End(v)). Let Abn nor (e) denote the set of 
points connected to the origin by curves which are both normal and abnormal. Let 
Abn ,m (e) denote the set of points connected to the origin by abnormal curves that 
are locally length minimizing with respect to the sub-Riemannian distance. 

Lemma 2.32. Let G be a polarized Lie group. The Sard Property holds for normal 
abnormals. Namely, the set Abn" or (e) is contained in a sub-analytic set of codimen¬ 
sion at least 1. 

Proof. We will make use of the sub-Riemannian exponential map, see []. Namely, 
normal curves starting from e have cotangent lifts which satisfy a Hamiltonian equa¬ 
tion. Solving this equation with initial datum £ G TfG defines a control Exp(f) G 
L 2 ([0,1], V). Composing with the endpoint map, one gets the sub-Riemannian expo¬ 
nential map Exp : TfG —>■ G. 

Exp = End o Exp. 

Points in Abn nor (e) are values of Exp where the differential of End is not onto. 
Therefore, they are singular values of Exp. Since Exp is analytic, the set of its 
singular points is analytic, thus the set of its singular values is a sub-analytic subset 
of G. By Sard’s theorem, it has measure zero, therefore its codimension is at least 
1 . □ 

2.8. The Goh condition. Let (G , V) be a polarized group as in Section 12.71 We 
introduce the well-known Goh condition by using the formalism of Corollary 12.141 

Definition 2.33. We say that an abnormal curve 7 : [0,1] —> G leaving from the 
origin e satisfies the Goh condition if there exists A G g* \ {0} such that 

(2.34) A(Ad 7 (q(R + [V, R])) = 0 for every t G [0,1]. 

Equivalently, 7 satisfies the Goh condition if and only if there exists a right-invariant 
1-form a on G such that a(A 2 ^) = {0} for every t G [0,1], where A 2 is the left- 
invariant distribution induced by V+ [R, V]. Equivalently, denoting by u the controls 
associated with 7 and recalling Proposition 12.31 if and only if the space 

(2.35) U Ad 7 W (R+[R,R]) = d J R; ( 1 1) (Im(dEnd u ))+ |J Ad 7(t) ([V, R]) 

as[0,1] te[o,i] 

is a proper subspace of g = T e G, which a posteriori is contained in ker A, for A as in 

02221 - 

Remark 2.36. Clearly, any A such that (I2.34p holds is in the annihilator of V + [V, V ], 
just by considering t = 0 in (I2.34D . 

The importance of the Goh condition stems from the following well-known fact: if 
7 is a strictly abnormal length minimizer (i.e., a length minimizer that is abnormal 
but not also normal), then it satisfies Goh condition for some A G g* \ {0}. See 
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[AS041 Chapter 20] and also [ AS96] , Notice that not necessarily all the A’s as in (2) 
of Corollary 12.141 will satisfy (I2.34p . but at least one will. On the contrary, in the 
particular case dim F = 2, every abnormal curve satisfies the Goh condition for every 
A as in Corollary 12.141 (2): see Remark 12.81 and (12.9(1 in particular. 

3. Step-2 Carnot groups 

3.1. Facts about abnormal curves in two-step Carnot groups. We want to 
study the abnormal set Abn(e) defined in (12.13jl with the use of the abnormal varieties 
defined in (I2.2ip . In fact, by Proposition 12.221 we have the inclusion 

Abn(e) C |J Z A . 

Aeg*\{0} s.t. e.GiZ*' 

In this section we will consider the case when the polarized group (G, F) is a Carnot 
group of step 2. Namely, the Lie algebra of G admits the decomposition g = F © F 
with V = Fi, [Vi, Vi] = V 2 , and [g, F] = 0. Fix an element A G g*. Since g* = F*©F*j 
we can write A = Ai + A2 with A* G V*. As noticed in Remark 12.261 since G has step 
2, if X G g and Y G Fi, then 

(Ad« pW )*A(F) = = AiY) + A 2 ([X, Y]). 

Notice that, if e = exp(0) G Z x , then Ai(F) = 0 for all Y G V\. Thus Ai = 0. 
Therefore, any variety Z x containing the identity is of the form 

F A = Z Az = exp {A G g : A 2 ([A, Y}) = 0 V Y G F}. 

The condition 

A 2 ([A,F]) = 0, VF G Fi, 

is linear in X, hence the set 

3 A := log(Z A ) = {A G g : A 2 ([A, Y]) = 0 VF G F} 

is a vector subspace. One can easily check that exp(F 2 ) C Z x , hence F 2 C 3 A . In 
particular, 3 A is an ideal and Z x = exp(j A ) is a normal subgroup of G. Actually, 
one has ^ A = (3 A D Fi) © F 2 . The space 3 A D V\ is by definition the kernel of the 
skew-symmetric form on Fi, which we already encountered in (12.15p . dehned by 

m(A):(A,F)^A 2 ([A,F]). 

If now 7 is a horizontal curve contained in Z x (and hence abnormal) with 7(0) = 0, 
then 7 is contained in the subgroup H x generated by 3 A O Fi, i.e., 

(3.1) H x := exp((3 A 0 F) © [ 3 A D F, 3 A D F]). 

This implies that 

Abn(e) C (J H x . 

Ae 0 *\(o} 

Ai=0 
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It is interesting to notice that also the reverse inclusion holds: indeed, for any A G 
0* \ {0} with Ai = 0 and any point p G H x , there exists an horizontal curve 7 from 
the origin to p that is entirely contained in H x \ 7 is then contained in Z x and hence 
it is abnormal by Proposition 12.221 We deduce that 

(3.2) Abn(e) = [j H x . 

ag 0 *\{o} 

Ai=0 

We are now ready to prove a key fact in the setting of two-step Carnot groups: 
every abnormal curve is not abnormal in some subgroup. We first recall that a 
Carnot subgroup in a Carnot group is a Lie subgroup generated by a subspace of the 
first layer. 

Lemma 3 . 3 . Let G be a 2-step Carnot group. For each abnormal curve 7 in G, there 
exists a proper Carnot subgroup G' of G containing 7, in which 7 is a non-abnormal 
horizontal curve. 

Proof. Let 7 be an abnormal curve in G. Then there exists A G {0}, with Ai = 0, 
such that 7 C H x , where H x is the subgroup defined in (13.11) . By construction H x is 
a Carnot subgroup. Since A 7^ 0 then H x is a proper subgroup (of step < 2). 

If 7 is again abnormal in H x , then we iterate this process. Since dimension de¬ 
creases, after finitely many steps one reaches a proper Carnot subgroup G' in which 
7 is not abnormal. □ 

3.2. Parametrizing abnormal varieties within free two-step Carnot groups. 

Let G be a free-nilpotent 2-step Carnot group. Let m < r := dim(Li). Fix a m- 
dimensional vector subspace W' m C V\ . Denote by G m the subgroup generated by 
W ' m , and X m = GL(r,M .) x G m , equipped with the left-invariant distribution given 
at the origin by W m := {0} © W' n . Observe that GL(r, M) acts on G by graded 
automorphisms. Let 

■ X m G, ( g , h ) (->• g(h). 

In a polarized group (A", V), given a submanifold Y c A, the endpoint map relative 
to Y is End 5 : Y x L 2 ([ 0,1], V) —>■ X, ( y,u ) ha 7^(1), where 7^ satisfies (12.ip with 
7« (0) = V- We say that a horizontal curve 7 with control u is non-singular relative 
to Y if the differential at (7(0), u) of the endpoint map relative to Y is onto. 

Lemma 3 . 4 . Let G be a free 2-step Carnot group. For every abnormal curve 7 in G, 
there exists an integer m < r and a horizontal curve a in X rn such that < F m (cr) = 7, 
and a is non-singular relative to &^f(e). 

Proof. Let 7 be an abnormal curve in G starting at e, with control u. By Lemma [3731 
7 is contained in the Carnot subgroup G ' of G generated by some subspace V[ C V\ 
and is not abnormal in G’. Let m = dim(V L / ). Then there exists g G GL(r, M) 
such that V[ = g(W' n ), and thus G ' = g(G m ). Let a = (g,g -1 (7))- This is a 
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horizontal curve in X m . Consider the endpoint map on X m relative to the submanifold 
«h- 1 (e) = GL(r,M) x {e}. Since 7 is not abnormal in G', the image / of the differential 
at ((g, e), g^ 1 (u)) of the endpoint map contains {0} © T g -i( 7 ( 1 ))G TO . Every curve of 
the form t ha (/c, 5 ,_1 (7(t))) with fixed k G GL(r,M) is horizontal, so / contains 
T g (GL(r, M))©{0}. One concludes that I = X m , i.e., a is non-singular relative 

to $“ 1 (e). By construction, $ m (cr) =7. □ 

3.3. Application to general 2-step Carnot groups. 

Proposition 3.5. Let G be a 2-step Carnot group. There exists a proper algebraic 
set Sc G that contains all abnormal curves leaving from the origin. 

Proof. Let / : G —» G be a surjective homomorphism from a free 2-step Carnot group 
of the same rank as G. Let 7 be an abnormal curve leaving from the origin in G. It 
has a (unique) horizontal lift 7 in G leaving from the origin. According to Lemma 13.41 
there exists an integer m and a non-singular (relative to < L“ 1 (e)) horizontal curve a 
in X m such that $ m (a) = 7 , i.e., / o $ m (a) = 7 . Namely, there exists g G GL(m,R) 
such that a(t) = (g, g _ 1 7 (f)). Consider the endpoint map End 5 on X m relative to 
the submanifold Y := Let us explain informally the idea of the conclusion of 

the proof. The composition / o o End 5 is an endpoint map for G, with starting 
point at the identity e. Hence, since the differential of End 5 at the control of a is 
onto, but the differential of / o o End 5 is not, the point 7 ( 1 ) is a singular value of 
/ o <L m . Hence, we will conclude using Sard’s theorem. 

Let us now give a more formal proof of the last claims. Consider the map (f) m : 
Y x L 2 ([0,1], W m ) -A L 2 ([0,l],Vi), defined as (cj) m (g,u))(t) := g(u(t)) G fj C T e G, 
for t G [0,1]. We then point out the equality 

(3.6) / o <L m o End v = End o /* o ^ m , 

where End : L 2 ([0,l],Vi) —> G is the endpoint map of G and /* : L 2 ([0,l],Hi) —> 
L 2 ([0,1], Vi) is the map 

(Mu))(t) = (df) e (u(t))eV 1 cT e G. 

Since a is abnormal, i.e., the differential dEnd„ 7 is not surjective, and the differential 
of End y at the point ( g,u a ) = (/* o -0 m )u 7 is surjective, from (13.6jl we deduce that 
7(1) = End Y (g,u a ) is a singular value for / o<L m . By the classical Sard Theorem, the 
set E m of singular values of /o <L m has measure 0 in G. So has the union E := E m 
of these sets. By Tarski-Seidenberg’s theorem [ BCR98 . Proposition 2.2.7], E is a semi- 
algebraic set, since the map / o <f> m is algebraic and the set of critical points of an 
algebraic map is an algebraic set. Moreover, from [ BCR98 . Proposition 2.8.2] we have 
that this semi-algebraic set is contained in an algebraic set E of the same dimension. 
Since E has measure zero, the set E is a proper algebraic set. □ 
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Example 3.7 (Abnormal curves not lying in any proper subgroup). Key to our proof 
was the property, encoded in Equation (13.11) . that every abnormal curve is contained in 
a proper subgroup of G. This property typically fails for Carnot groups of step greater 
than 2. Gole and Karidi |GK95 ] constructed a Carnot group of step 4 and rank 2 for 
which this property fails: namely, there is an abnormal curve that is not contained in 
any proper subgroup of their group. Further on in this paper (Section 16.3ft we show 
that this property fails for the free 3-step rank-3 Carnot group. 

3.4. Codimension bounds on free 2-step Carnot groups. In this section we 
prove Theorem 11.41 we will make extensive use of the result and notation of Sec¬ 
tion 13.11 In the sequel, we denote by G a fixed free Carnot group of step 2 and by 
r = dim V\ its rank. 

We identify G with its Lie algebra, which has the form E © A 2 E for V — V\ = M r a 
real vector space of dimension r. The Lie bracket is [(u,£), (w,rj)] = (0,vAw). When 
we use the exponential map to identify the group with its Lie algebra, the equation 
for a curve (x(t),£(t)) to be horizontal reads 

x = u, ( = iAm. 

If IE C Lisa subspace, then the group it generates has the form IE©A 2 IE C E©A 2 E. 

3.5. Proof that Abn(e) is contained in a set of codimension > 3. We use the 

view point discussed in Section [2ZD where we defined the sets 3 A and H x . We first 
claim that 

(3.8) dim a A n V = dim {X e V : A 2 ([W, E]) = 0 V Y G V} < r - 2, 

for any A G g* \ { 0 } such that Ai = 0 . Indeed, since A 2 ^ 0 , the alternating 2-form 
w( A) : (X,Y) i—^ A 2 ([X, y]) has rank at least 2. 

Then, by (13.81) . each 3 A D V is contained in some W C V with dim (IE) = r — 2, 
hence H x C IE © A 2 IE and, by (13.21) . 

Abn(e) = (J H x C (J IE © A 2 fE 

AG 0 *\{O} W £ Gr(r,r—2) 

Ai=0 

In fact, the equality 

(3.9) Abn(e) = [j IE © A 2 fE 

WG Gr(r,i —2) 

holds: this is because every codimension 2 subspace IE C E is the kernel of a rank 2 
skew-symmetric 2-form (the pull-back of a nonzero form on the 2-dimensional space 
E/IE), and every such skew-symmetric form corresponds to a covector A 2 G E 2 * = 
A 2 E*. 
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We now notice that the Grassmannian Gr(r, r — 2) of (r — 2)-dimensional planes in 
V has dimension 2(r — 2) and that each W © A 2 IP is (isomorphic to) the free group 
F m ,2 of rank m — r — 2 and step 2, i.e., 

.. /TTr . o TTrN m(m — 1) (r — l)(r — 2) 

dirri(IF © A 2 IP) = m H---= --—-. 

It follows that the set UweGr(r,r- 2 )W © A 2 IP can be parametrized with a number of 
parameters not greater than 

r(r + 1) 

dim F m2 + dim Gr (r, m) =---3. 

Since dim G = r(r + l)/2, the codimension 3 stated in Theorem 11.41 now follows from 
(13791) . □ 


3.6. Proof that Abn(e) is a semialgebraic set of codimension > 3. Let k = 

L(r — 2)/2j and let W be a codimension 2 vector subspace of V\. Every pair (£,77) G 
IP © A 2 IP can be written as 

r —2 k 

£ = Osr V = 1 A 

j=1 i= 1 

for some (r — 2)-uple of vectors (e.g., a basis) (£j)i<j < r -2 of IP. Conversely, every 
pair (^, ?/) G 0 = P © A 2 P of this form belongs to IP © A 2 IP for some codimension 2 
subspace IP of Pi. Therefore 

(J IP © A 2 IP 

W£ Gr(r,i —2) 

is the projection on the first factor of the algebraic subset 

r —2 k 

{(£, V, 6, ■ ■ ■ , fr-2, X U ..., X r -2 , ^1, • ■ ■ , Z k ) : P/Cb V = Z i^2i-1 A 6*} 

i=l i=l 

of g x P r ~ 2 x M r_2 x M fc . Since the exponential map is an algebraic isomorphism, 
Abn(e) = Uwe Gr(r,r- 2 ) IP©A 2 IP is semi-algebraic, and it is contained in an algebraic 
set of the same codimension (see [ BCR981 Proposition 2.8.2]). □ 

In the rest of this section we proceed with the more precise description of the set 
Abn(e), as described in Theorem 11.41 

Each f G A 2 P can be viewed, by contraction, as a linear skew symmetric map 
£ : V* —* P. For example, if £ = vAw, then this map sends a G V* to a(v)iv — a(w)v. 

Definition 3.10. For £ G A 2 P let supp(£) C P denote the image of £, when £ is 
viewed as a linear map V* —> V. For (u,£) G P©A 2 P set supp(u,£) = Mu + supp(£). 
Finally, set rank(u,£) = dim(supp(u,£)). 
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Proposition 3.11. If G is the free 2-step nilpotent group on r generators then 

Abn(e) = {(v, £) : rank(n, £) < r — 2 }. 

Proof. From (13.9p we can directly derive the new characterization. Suppose that W C 
V is any subspace and (w,£) £ W ©A 2 W. Then clearly supp(w,£) C W. Conversely, 
if (w, £) has support a subspace of W, then one easily checks that (w, £) £ W ©A 2 W. 
Taking W an arbitrary subspace of rank r — 2 the result follows. □ 

By combining Proposition 13. Ill with some linear algebra we will conclude the proof 
of Theorem 1 1.41 This proof is independent of Sections 13. 5l and l3.Gl and yields a different 
perspective on the abnormal set. 

Proof of Theorem \1.4\ Let G be the free-nilpotent 2-step group on r generators. First, 
we write the polynomials defining Abn(e), then we compute dimensions. It is simpler 
to divide up into the case of even and odd rank r. We will consider the case of even 
rank in detail and leave most of the odd rank case up to the reader. 

The linear algebraic Darboux theorem will prove useful for computations. All 
bivectors have even rank. This theorem asserts that the bivector £ £ A 2 V has rank 
2 m if and only if there exists 2 m linearly independent vectors ex, /i, e^ /2 ,... e m , fm 
in V such that £ = YPf =x ei A ft. 

Let us now specialize to the case where r = dim(D) is even. Write 

r = 2s. 

Using Darboux one checks that rank(0,£) < r — 2 if and only if £ s = 0 (written 
out in components, £ is a skew-symmetric 2r x 2 r matrix and the vanishing of £ s 
is exactly the vanishing of the Pfaffian of this matrix). Now, if rank(0,£) = r — 2 
and rank(u,£) < r — 2, it must be the case that v £ supp(£); equivalently, in the 
Darboux basis, v = + S™ ,/y/,. It follows in this case that v £ supp(£) if 

and only if v A £ s_1 = 0. Now, if rank(0,£) < r — 2 then rank(0,£) < r — 4 and so 
rank(u,£) < r — 3 for any v £ V. But rank(0,£) < r — 2 if and only if £ s_1 = 0 in 
which case automatically v A £ s_1 = 0. 

We have proven that in the case r = 2s, the equations for Abn(e) are the polynomial 
equations = 0 and v A £ s_1 = 0. 

To compute dimension, we stratify Abn(e) according to the rank of its elements. 
The dimensions of the strata are easily checked to decrease with decreasing rank, so 
that the dimension of Abn(e) equals the dimension of the largest stratum, the stratum 
consisting of the (u, f) of even rank r — 2. (The Darboux theorem and a bit of work 
yields that the stratum having rank k with k odd consists of exactly one Gl(V ) orbit 
while the stratum having rank k with k even consists of exactly two Gl(V) orbits). A 
point (v, £) is in this stratum if and only if £ s = 0 while ^ 0 and v £ supp(£). Let 
us put the condition on v aside for the moment. The first condition on £ is the Pfaffian 
equation which defines an algebraic hypersurface in A 2 D, the zero locus of the Pfaffian 
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of £. The second equation for £ defines the smooth locus of the Pfaffian. Thus, the 
set of £’s satisfying the first two equations has dimension 1 less than that of A 2 V , so 
its dimension is (^j — 1. Now, on this smooth locus {Pf = 0} smoot h C {Pf = 0} we 
have a well-defined algebraic map F : {Pf = 0} smoo th —> Gr(r, r — 2) which sends £ to 
F(£) = supp(£). Let U —> Gr(r, r — 2) denote the canonical rank r — 2 vector bundle 
over the Grassmannian. Thus U C M r x Gr(r, r — 2) consists of pairs (v, P) such that 
v G P. Then F*U is a rank r — 2 vector bundle over {Pf = 0} smoot h consisting of pairs 
(u,£) G M 2 x A?V such that v G supp(£) and £ has rank r — 2. In other words, the 
additional condition v G supp(£) says exactly that (u, £) G F*U. It follows that the 
dimension of this principle stratum is dim (F*U) = ((!,) — 1) + (r — 2) = dirn(G') — 3. 

Regarding the odd rank case 

r = 2s + 1 

the same logic shows that the equations defining Abn(e) are £ s = 0 and involves no 
condition on v. A well-known matrix computation [Arn7lj shows that the subvariety 
{£ s = 0} in the odd rank case has codimension 3. Since the map V © A 2 R —> A. 2 V 
is a projection, and since Abn(e) is the inverse image of {£ s = 0} C A 2 !/ under this 
projection, its image remains codimension 3. □ 

Recall that the rank of £ G A 2 R is the (even) dimension d of its support. For an 
open dense subset of elements of A 2 R, the rank is as large as possible: r if r is even 
and r — 1 if r is odd. We call singular the elements £ G A 2 R whose rank is less than 
the maximum and we write (A 2 R) S i ng to denote the set of singular elements. From 
Proposition 13.111 we easily deduce the following. 

Proposition 3.12. The projection of Abn(e) onto A 2 V coincides with the singular 
elements (A 2 R) sing C A 2 V . 

Remark 3.13. A consequence of the previous result is the fact that elements of the 
form (0, £) where rank(£) is maximal can never be reached by abnormal curves. Notice 
that such elements are in the center of the group. 

To be more precise about Abn(e) we must divide into two cases according to the 
parity of r. 

Theorem 3.14. If G — V © A 2 R is a free Carnot group with odd rank r, then 
Abn(e) = V (B (A 2 R) sing . 

The previous result, as well as the following one, easily follows from Proposi¬ 
tion [37TT] To describe the situation for r even, let us write (A 2 V)d for those elements 
of A 2 V whose rank is exactly d and (A 2 V) <c i for those elements whose rank is strictly 
less than d. 
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Theorem 3.15. If G = V © X 2 V is a free Carnot group with even rank r, then 
Abn(e) is the union Y U Y\ of the two quasiprojective subvarieties 

Y = {(v,0 eV®A 2 V:ve supp(£),£ 6 (AV) r _ 2 } 

Y 1 = Vx (AV) <r _ 2 . 

In particular, Abn(e) is a singular algebraic variety of codimension 3. 

We observe that Y\ — Y \ Y. 

Remark 3.16. Given any g = (v,£) G G we can define its singular rank to be the 
minimum of the dimensions of the image of the differential of the endpoint map 
dEnd(7), where the minimum is taken over all 7 that connect 0 to g. Thus, the 
singular rank of g = 0 is r and is realized by the constant curve, while if £ is generic 
then the singular rank of g = (0,£) is dim(G), which means that every horizontal 
curve connecting 0 to g is not abnormal. 

It can be easily proved that, if r is even and v G supp(£), then the singular rank of 
g is just rank(£). I11 this case we take a A with ker(A) = supp(£) and realize g by any 
horizontal curve lying inside G{ A). 

4 . Sufficient condition for Sard’s property 

In Section 12.11 we observed that, given a polarized group (G, V ) and a horizontal 
curve 7 such that 7(0) = e and with control u, the space (di? 7 (i)) e V’ + (dL 7 (i)) e H + 
5(7(1)) is a subset of Im(d End,,) C T^G. Therefore, if g G G is such that 

(4.1) Ad g -i 1/ + 1/ + (d L g )- l X(g) = g, 

for some subset X of 5, then g is not a singular value of the endpoint map. Here we 
denoted with X(g) the space of vector fields in X evaluated at g. In particular, if the 
equation above is of polynomial type (resp. analytic), then (G,V) has the Algebraic 
(resp. Analytic) Sard Property. 

In the following we embed both sides of (14.ip in a larger Lie algebra g, and we find 
conditions on g that are sufficient for (14.ip to hold. The idea is to consider a group G 
that acts, locally, on G via contact mappings, that is, diffeomorphisms that preserve 
the left-invariant subbundle A. It turns out that the Lie algebra g of G, viewed as 
algebra of left-invariant vector fields on G , represents a space of contact vector fields 
of G. 

4.1. Algebraic prolongation. Let G be a Lie group and G and H two subgroups. 
Denote by g, g, and I) the respective Lie algebras seen as tangent spaces at the identity 
elements. We shall assume that H is closed. Suppose that g = f) © g and that we are 
given the decompositions in vector space direct sum 

1) = V-h © • • • © Vq 
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and 

0 = K © ■ ■ • ® V, 

in such a way that g is graded, namely [Id, Vf\ C V l+ j , for i , j = —h ,..., s, and g is 
stratified, i.e., [Vj, Vf] = Vj +1 for j > 0. In other words, g is a (finite-dimensional) 
prolongation of the Carnot algebra g. 

We have a local embedding of G within the quotient space G/H := {gH : g e G} 
via the restriction to G of the projection 

Ti :G —> G/H 

p i —y 7r(p) := \p] :—pH. 

The group G acts on G/H on the left: 

L- g : G/H G/H 

gH i 't Lg(gH):=~ggH. 

We will repeatedly use the identity 

(4.2) Lg o ti = 7T o Lg. 

On the groups G and G we consider the two left-invariant subbundles A and A 
that, respectively, are defined by 

A e := 1) + W, 

A e := Vl 

Notice that both subbundles are bracket generating g and g, respectively. Moreover, 
A is adf,-invariant, hence it passes to the quotient as a G'-invariant subbundle A on 
G/H. Namely, there exists a subbundle A of the tangent bundle of G/H such that 

A = d7r(A). 

Lemma 4.3. The map 

z:=7T| g :(G,A) -A (G/H, A) 

g ^ gH 

is a local diffeomorphism and preserves the subbundles, i.e., it is locally a contacto- 
morphism. 


Proof. Since g is a complementary subspace of 1) in g, the differential (di) e is an 
isomorphism between g and T^G/H. Since by Equation (14.21) the map ti is G- 
equivariant, then (d i) g is an isomorphism for any arbitrary g e G. Hence, the map i 
is a local diffeomorphism. If X is a left-invariant section of A then 


(d i) g X, 


d 
d t 


[gexp(tX e )} 




since X e e V\. 


t =o 


□ 
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Let 7r g : g = V-h © • • • © Vo © 0 —» g be the projection induced by the direct sum. 
The projections n and 7r g are related by the following equation: 


(4.4) 


(d7r) e = (d7r) e|e 7T 0 . 


Indeed, if Y 
£exp (tY)H 


G 0, then the formula trivially holds; 
= 0 . 


4=0 




if Y G i) , then (d7r) e F = 


4=0 


The differential of the projection n at an arbitrary point g can be expressed using 
the projection 7T 0 via the following equation: 


(4.5) (d?r)g = (d(Lg o 7T| G )) e o 7T 0 o {dL- g -x)g. 

Indeed, first notice that (d7T| G ) e = (d7r) e | , then from (14.4p and (14.2p we get 

( d(L~ g 0 1T\ G )) e 0 7r s 0(dLg-l)g = ( dL g ) [e] O (dVf) e , O 7T 0 O ( dLg ~ 1 ) g 

= (dLg) [e] 0(dTT) e 0(dLg-l)~g 
= d^lgO-K O (LgY 1 )^ = (d'K)g. 


4 . 2 . Induced contact vector fields. To any vector X G T e G ~ g we want to 
associate a contact vector field X G on G. Let X R be the right-invariant vector field 
on G associated to X. We define X G as the (unique) vector field on G with the 
property that 

dvr(X i? ) = df(X G ), 


as vector fields on i(G). In other words, we observe that there exists a (unique) vector 
field X on G/H that is 7r-related to X R and i -related to some (unique) X G . The flow 
of X R consists of left translations in G, hence they pass to the quotient G/H. Thus 
X shall be the vector field on G/H whose flow is 

= n(exp(tX)g) = exp (tX)gH = L exp{t x)(gH). 


In other words, we define A" as the vector field on G/H as 


(4.6) 


X [ p] := (d7r)(A" ) p = — ir(exp(tX)p) 


Wp G G. 


4=0 


Definition 4.7. For all iGg and g £ G, we set 

(X G ), := (d(iT| < ,) s )- 1 (dx),(die s ).X. 


From (14.51) . the vector field X G satisfies 
( 4 . 8 ) (X G )g = d(Lg lG U s Adg-X X , G G, 

We remark that if X G g C g then X G = X R , as vector fields in G. 
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Proposition 4.9. Let X G be the vector field defined above. Then 

i) X G has polynomial components when read in exponential coordinates. 

ii) X G is a contact vector field, i.e., its flow preserves A. 


Proof. Because the algebra g is graded, we have that for every X e g the map &dx 
is a nilpotent transformation of g. Consequently, for all g e G, the map Ad 9 is a 
polynomial map of g. Therefore, in exponential coordinates, X^ is a polynomial 
vector field and X G is as well. 


We next show that the vector field in (14.61) is contact, in tother words, each map 
■ p preserves A. Any vector in A is of the form dn(Y~ L ) with Y e G f) + V\ and g € G. 


We want to show that (dL p )[gfid7r)g(Y~ J ) is in A. In fact, using (14.21) . we have 

(dLMdirMYf) = d(l p ony g (Yf) 

= d(vro L p )g(Yf) 

= dn p ~ g {dL p )~ g {Y~ L ) 

= dv T P g(Y p L -) e dvr (A). 

Now that we know that X is a contact vector field of G/H , from Lemma 14.31 we 
deduce that the vector field X G , which satisfies X = df(A" G ), is a contact vector field 
on G. □ 


For a subspace W C g we use the notation 

W G := {X G e Vec(G) | X e W}. 


Corollary 4.10. If S denotes the space of global contact vector fields on G that vanish 
at the identity, we have 

1) G C 5. 


Proof. Let X 6 f). We already proved that X G is a contact vector field on G. We 
only need to verify that (X G ) e = 0. Since A" G is f-related to A, it is equivalent to 
show that (X) e = 0, but 


as desired. 


(A) e = — 7r(exp(tA)) 


t =o 


= Tt H 


= o, 


t =0 


□ 


4.3. A criterion for Sard’s property. For g e G, denote S(g) = {f(g) \ f G 5}. 
Also, define 

£:={ g eG \ {RgflV, + (L 9 )*W + S(g) = T g G}. 

Given a horizontal curve 7 with control u, from Section [2711 we know that 
(i? 7 (i))*Vi + (L 7 ( 1 ) )*Pi + 5 ( 7 ( 1 )) C Im(dEnd u ) C T 7 ( 1 )G ! . 
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Therefore, if the set £ is not empty then the abnormal set is a proper subset of G. 
Moreover, observing that £ is defined by a polynomial relation (see Proposition 14.9p . 
we can deduce that, whenever £ is not empty then G has the (Algebraic) Sard Prop¬ 
erty. 


Proposition 4.11. Let G be a Carnot group and let G and H as in the beginning of 
Section \fJ\ Let 0,0 and fi be the corresponding Lie algebras. Assume that there are 
p G G and g G G such that pH = gH and 


1) + Pi + Adp-i (f) + Pl) — 0 . 

Then 

(4.12) (L 5 )*Pi + {R g )*V\ + 1 f(g) = T g G. 

Moreover, the above formula holds for a nonempty Zariski-open set of points in G, 
and so G has the Algebraic Sard Property. 


Proof. Project the equation using 7 r 0 : f) © 0 —» 0 and get 

11 + 7r g Adp-i(f) + Pi) = 0. 

Apply the differential of L p o 7T| g , i.e., the map 

d (L p o 7 T| G ) e : 0 = T e G —>■ T[ p fG/H) 

and get 

d(Zp o 7T| G ) e Pi + d (L p o 7T| G ) e 7r 0 Adp-i(f) + Pi) = T [p] (G/H). 

By Equation (14.51) . the left hand side is equal to 

d(Lp) [e] (di) e Pi + (d7T) p (di2p)(f) + Pi) 

= d(Zp) [e] (dz) e Pi + (d7T)p((l) + Pi) K )p 

= d(Zp) [e] (dz) e Pi + (d7) 3 (([) + Pi ) G ) 9 

= (d 7 ),d(L,) e Pi + (di) 9 (di? g ) e Pi + (di) g t) G (g). 

Now (I4.12p follows because (di ) 9 in an isomorphism. Since (14.121) is expressed by 
polynomial inequations, also the last part of the statement follows. □ 

We give an infinitesimal version of the result above. 

Proposition 4.13. Assume that there exists ( 6 g such that 

fl + Pi + ad^(f) + Pi) = 0 . 

Then there are p G G and g G G such that pH = gH and 

fl + Pi + Adp-i(f) + Pi) = 0. 
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Proof. For all t > 0, let p t := exp(t£). Take Yj,..., Y rn a basis of f) + V\. Let 
Y‘ := Ad p ,(i>') = ad 5 (y) +1 £ - 

Notice that Yf —* ad^(Fj), as t —* 0. Then we have 

f) + K + Ad pt (fj + V,) = span {Y 1 ,..., Y m , Y(\ ..., Y/ n }. 

Since 

span{Yi,..., Y m , Y?, ...,Y°} = ( 1 + V 1 + ad ? (f) + Vf) = g, 

then Yi ,..., Y m , Yf,..., Y^ span the whole space g for t > 0 small enough. Moreover, 
since p t —> e e G and hence \p t ] —> [e] G G/H, for t > 0 small enough there exists 
g G G such that [ g] = [p t ], because i : G —> G/H is a local diffeomorphism at 
e E G. □ 


Combining Proposition 14.111 and 14.131 we obtain the following. 

Corollary 4.14. Let G be a Carnot group with Lie algebra g. Let g and fi as in the 


beginning of Section \f.l\ Assume that there exists £ £ g such that 

l) + Vi + adg(f) + Vt) = g. 

Then G has the Algebraic Sard Property. 


5. Applications 

In this section we use the criteria that we established in Section [I] in order to prove 
items (2) to (4) of Theorem 11.21 The proof of (5) and ( 6 ) will be based on (14.ip and 
Corollary 14.141 

The free Lie algebra on r generators is a graded Lie algebra generated freely by an 
r-dimensional vector space V. It thus has the form 

fr,oo = V © V2 © V3 © . . . 

Being free, the general linear group GL(V ) acts on this Lie algebra by strata-preserving 
automorphisms. I 11 order to form the free fc-step rank r Lie algebra f r .k we simply 
quotient f rj00 by the Lie ideal © s >fcV r s . Thus, 


fr,k — V © Vi © . . . © Vfc. 
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5.1. Proof of (2) and (3). We consider the free nilpotent Lie group F 2 a with 
2 generators and step 4, and the free nilpotent Lie group F 33 with 3 generators 
and step 3. Their Lie algebras are stratified, namely f 2 ,4 = p © V 2 © V 3 © p and 

jp — IP 1 © IP 2 © W 3 . 

The Lie algebra f 2i 4 is generated by two vectors, say *i,* 2 , in p, which one can 
complete to a basis with 

*21 = [* 2 ,*i] 

X 2U = [X 21 ,X 1 ] X 212 = [x 21 ,x 2 ] 

*2111 = [*211, Ad] *2442 = [*244, * 2 ] = [*242, *l] *2422 = [*242, X 2 \. 

We apply Corollary 14.141 to verify the Algebraic Sard Property for F 2 , 4 - We take f) to 
be the space of all strata preserving derivations of f 2j 4 , which in this case are generated 
by the action of g!(2, R) on p. Choose £ = A" 2 + *242 + * 2444 - Then [£, Pi] contains 
the vectors *24 + *2442 and * 2422 - Next, consider the basis {Ip | i,j = 1,... ,2} 
of gl(2,R), where E t j denotes the matrix that has entry equal to one in the (op¬ 
position and zero otherwise. We compute the action of the derivation defined by each 
one of the Fps on £. Abusing of the notation E i3 for such derivations, an elementary 
calculation gives 

*ll£ = *242 + 3A 2444 *12£ = *4 + *244 

*22£ = *2 + 2*242 + *2444 *2l£ = 2*2442- 

Since we need to show that P 4 + ad^ Pi = g, it is enough to prove that P 2 © P © P = 
(ad^Pi) mod Pi, which follows from direct verification. 

We consider now the case of the free nilpotent group of rank 3 and step 3. The 
Lie algebra of F 3i3 is bracket generated by three vectors in Vp, say Ad, * 2 , * 3 , which 
give a basis with 

*21 = [*2, *l] *31 = [*3, *l] *32 = [*3, *2] 

(5.1) *211 = [*21, *l] *212 = [*21, *2] *213 = [*21, * 3 ] 

*311 = [*3l, *1] *312 = [*31, *2] *313 = [*31, * 3 ] 

*322 = [*32,*2] *323 = [*32, *3] ■ 

We have the bracket relation [* 32 ,*i] = *312 — * 213 • We apply Corollary 14.141 
to verify the Algebraic Sard Property for F 3 . 3 . We choose £ = *21 + *31 + *"32 + 
*312 + * 213 , and we consider the action of f) on it. In this case 1) = gl(3,R). Let 
Eij 6 gl(3, R) be the matrix that has entry equal to one in the (i, j)-position and zero 
otherwise. Then the set {E i3 \ i, j — 1,..., 3} is a basis of gt(3, R). We compute the 
action of the elements of this basis on £. If i p j we obtain 

E\ 2 £ = *31 + *311 F 13 £ = —*21 + *211 *23^ = *21 + 2*212 
F 2 i£ = *32 + *322 *31 £ = —*"32 — *323 *32£ = *31 + 2* 3 13 
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whereas if i — j 

En£ = X21 + X 3 i + A" 2 i 3 + A 3 12 

E 2 2 ^ = X 2 ] + A 32 + A" 213 + A 312 
E 33 f = A31 + A 32 + A 2 i3 + A 3 12. 

Next, we consider [£, Vf\ and notice that it contains the vectors v = A" 2 i 2 + A" 3 i 2 + A" 322 
and w = A " 213 + A 313 + A 323 . It is now elementary to verify that the eleven vectors 
{EijC, | i,j = 1,2,3}, v and w are linearly independent and therefore are a basis of 
W 2 © Ih 3 ■ In conclusion, £ satishes the hypothesis of Corollary 14.141 

Remark 5.2. In the above proof, we had to chose the element £ properly. This was 
done considering how GL( 3) acts on F 33 . Actually, SL(3 ) acts by graded automor¬ 
phisms on f 3 3 . As a consequence each layer, W\ , W 2 and W 3 , form SL( 3) representa¬ 
tions. We will see in Section I6T21 that the third layer W 3 is isomorphic to 5 /( 3 ) with 
the adjoint representation of SL( 3). This observation allowed us to hnd the element 

e 

5.2. Semisimple Lie groups and associated polarized groups. We complete 
here the proof of Theorem 11.21 We first recall some standard facts in the theory of 
semisimple Lie groups. For the details we refer the reader to [ Kna02 ], To be consis¬ 
tent with the standard notation, only in this section we write G for a noncompact 
semisimple Lie group and N (rather than G) for the nilpotent part of a parabolic 
subgroup. 

If 6 is a Cartan involution of the semisimple Lie algebra g of G, then the Cartan 
decomposition is given by the vector space direct sum 

0 = t © P, 

where £ and p are the eigenspaces relative to the two eigenvalues 1 and —1 of 9. We 
fix a maximal abelian subspace a of p, whose dimension will be denoted by r. Let 
B be the Killing form on g; the bilinear form (X,Y) := —B(X,9Y) defines a scalar 
product on g, for which the Cartan decomposition is orthogonal and by which a can be 
identified with its dual 0*. We fix an order on the system S C a* of nonzero restricted 
roots of (g, a). Let m = {A 6 t \ [A", Y] = 0 VY 6 a}. The algebra g decomposes as 
g = m + a + © ae s0a) where g Q is the root space relative to a. We denote by E + the 
subset of positive roots. The Lie algebra of N, denoted n, decomposes as the sum of 
(positive) restricted root spaces n = ©a e s + 0a- 

Proof of (4). Denote by Il + the subset of positive simple roots. The space V = 
©< 5 en + 0<5 provides a stratification of n, so that (N,V) is a Carnot group. We prove 
that ( N , V) has the Algebraic Sard Property. Let w be a representative in G of 
the longest element in the analytic Weyl group. From |Kna021 Theorem 6.5] we 
have Adu; _1 h = n, where h — ©ae-S + 0Q- The Bruhat decomposition of G shows 
that N may be identified with the dense open subset NP of the homogeneous space 
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G/P, where P denotes the minimal parabolic subgroup of G containing N. Here we 
wrote N for the connected nilpotent Lie group whose Lie algebra is h. Now we apply 
Proposition 14. lll to 1) = rn+a+h. From our discussion it follows that fi+Ad'U© 1 !) = g. 
This equality holds true in a small neighborhood of w, so by density we can find p 
in G such that [p] = [n] for some n G N and for which (i + Adp -1 !} = g. Then by 
Proposition 14.111 we conclude that the desired Sard’s property for N follows. 

Proof of (5). From the properties of the Cartan decomposition it follows that [p, p] = 
£. Then (G, p) is a polarized group. We restrict to the case where g is the split 
real form of a complex semisimple Lie algebra. In order to show that (G, p) has the 
Analytic Sard Property, we show that there is £ G a such that ad^ p = t. If this holds, 
then by a similar argument of that in the proof of Proposition 14.131 we also have 
p + Ad a p = g for some g G G, from which we deduce the Analytic Sard Property. 
Let then £ be a regular element in a. This implies in particular that £ is such that 
a(£) 7 ^ 0 for every root a. Next, observe that for every a G £ and A" G g a , we may 
write 

xX(x-ex) + \(x + ex), 

where A" — OX G p and X + OX G t. We obtain 

[£, A - OX] = a (£)X - 0[0£, X] = a(£)(X + OX). 

The assumption that g is split implies in particular that {? is generated by vectors of 
the form X + OX, with X a nonzero vector in a root space. Since £ is regular, it 
follows that ad^ p = fi, which concludes the proof. 

We observe that if g is not split, then we do not find a vector £ such that p+ad^ p = g 
and so the same proof does not work. This can be shown, for example, by an explicit 
calculation on g = su(l, 2 ). 

Proof of (6). We observe that (G, ©aesflo) is a polarized group. Also in this case 
we assume that g is split. This implies that every root space g Q , a G S, is one 
dimensional, and that m = {0}. We recall that the Killing form B identifies a 
with a*. Let H a G a be such that a(H) = B(H a ,H ) for every H G a. Recall 
that [X a ,0X a ] = B(X a ,0X a )H a and B(X a ,0X a ) < 0. Let 8i,...,8 r be a basis of 
simple roots, and let X§. be a basis of g^ for every i = 1,... ,r. The set of vectors 
{Wy , • • •, H$ r } is a basis of a. Then the vector 

£ = Xs ± H-b X$ r 

satisfies [£, © Q esga] © a, whence © a enga + [£, ©aesfla] = 0 - Arguing as in the Proof 
of (5), we conclude that (G, © ae s 0 Q ) has the Analytic Sard Property. 
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5.3. Sard Property for some semidirect products. In this section we construct 
polarized groups that are not nilpotent and yet have the Algebraic Sard Property. 
These examples are constructed as semidirect products. 

Let ip : H —* Aut(G) be an action of a Lie group H on a Lie group G, i.e., ip is a 
continuous homomorphism from H to the group of automorphisms of G. Write "i/A 
for ip{h), for h G H . The semidirect product G xi^, H has product 

(5.3) (gi, hi) ■ (g 2 , h 2 ) = (gi^h^), hh 2 ). 

Let V C g be a polarization for G. Assume that 

(5.4) (A)*(V) = V for all h G H. 

We consider the group G x^ H endowed with the polarization V © f), where 1) is the 
Lie algebra of H. 

Proposition 5.5. Assume that G rx H is an action satisfying f|5.4|) . If (G,V) has 
the Algebraic Sard Property, so does (G x^ H, V © 1)). 


Proof. We show that Abnc*,^# (e) is contained in Abnc(e) ■ H . It is a consequence 
of (15.41) that a curve 7 (t) = (g(t), h(t )) in G := G x^, H is horizontal with respect to 
V + fi if and only if g{t) is horizontal in G and h{t) is horizontal in H. 

Hence, if g( 1) ^ Abric(e), i.e., g is not abnormal, from (12.4p . we have 


(dR 7(1 )) e 1 Im(dEnd U7 ) 


= span{Ad 7 ( t ) (V © fi) | t G [0,1]} 

~D V + t) + span{Ad 7 ( t )P | t G (0,1]} 

= V + t) + span{Ad (g (t), 0 ) Ad (0 ,/ l (q) V \ t G (0,1]} 
= V + f) + span{Ad( g (t ))0 )P | t G (0,1]} 

= 0 + 1 ), 


where we used first that (g,en) ■ {ec,h) = (g, h) and Ad( eGi / l )(t>, 0 ) = ((d'iph)eV, 0); 
then we used the assumption (15.4j) and the fact Ad^ 9teH )(v, 0 ) = (Ad 9 u, 0 ). □ 

Remark 5.6. If (G,V) is a free nilpotent Lie group for which the Algebraic Sard 
Property holds, we may take H to be any subgroup of GL(n, V ) and apply the 
proposition above to G x H. If (N, V) is a Carnot group as we defined in the first 
part of Section 15^1 then fi may be chosen to be any subalgebra of m©a. In particular, 
the Algebraic Sard Property holds for exponential growth Lie groups NA if N has 
step 2 . 


6. Step-3 Carnot groups 


Our first goal in this section is to prove Theorem 11.51 concerning the Sard Property 
for length minimizers in Carnot groups of step 3. A secondary goal is to motivate 
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the claim made in Example 13.71 that the typical abnormal curve in F 3 3 , the free 3- 
step rank-3 Carnot group, does not lie in any proper subgroup. To this purpose we 
illustrate the beautiful structure of the abnormal equations in this case. 

6.1. Sard Property for abnormal length minimizers. In [TY13] Tan and Yang 
proved that in sub-Riemannian step-3 Carnot groups all length minimizing curves are 
smooth. They also claim that in this setting all abnormal length minimizing curves 
are normal. Hence, Theorem 11.51 would immediately follow from Lemma [2.321 Being 
unable to follow some of the proofs in TV 13j . we prefer to provide here an independent 
proof of Theorem 11.51 which relies on the weaker claim that every length-minimizing 
curve is normal in some Carnot subgroup. 

Proof of Theorem \1.5l By Lemma 12.321 it is enough to estimate the set Abn^(e) of 
points connected to e by strictly abnormal length minimizers. Let 7 be such a curve 
starting from the origin e of a Carnot group G of step 3. Since 7 is not normal, then 
it satisfies the Goh condition; in particular, 7 is contained in the algebraic variety 

W x = {g e G : A(Ad s V 2 ) = 0} 

for some A 6 g*\ {0}. We now use Remark [2.361 Remark [2.261 and the fact that G is 
of step-3 to deduce that A £ Vf \ {0} and that W x is a proper subgroup of G. Hence 
also the accessible set H x in W x is a proper Carnot subgroup of G. 

Since 7 is still length minimizing in H x , either 7 is normal in H x , and we stop, or, 
being length minimizing, it is strictly abnormal (i.e., abnormal but not normal) in 
H x , and we iterate. Eventually, we obtain that 7 is normal within a Carnot subgroup. 
We remark that in this subgroup 7 may be abnormal or not abnormal. We do not 
need divide the two cases. We decompose 

Abifi(e) C U Abigr(e), 

G'<G 

where AbnJAT(e) is the union of all curves starting from e that are contained in G 1 , 
are normal in G', and are abnormal within G. 

The idea is now to adapt the argument of Lemma 12.321 for the union of the sets 
AbnJAT(e). Carnot subgroups of G are parametrized by the Grassmannian of linear 
subspaces of V\. The dimension of the subgroup is a semi-algebraic function on the 
Grassmannian. On each of its level sets Y m , all relevant data (e.g., coefficients of the 
Hamiltonian equation satisfied by normal length minimizing curves) are real analytic. 
The dual Lie algebras g'* form an analytic vector bundle over Y m . Denote by r m the 
total space of this bundle. It is a semi-analytic subset of TfG. The time 1 solutions 
of the Hamiltonian equations with inital data in r m give rise to real analytic maps 
Exp m : T m —* L 2 ([0,1], V). Each subgroup has its own geodesic exponential map, 
giving rise to an analytic map Exp m : T m —» G. Again, 


Exp m = Endo Exp m . 
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Every point in (Jg'<g Abn^ r (e) is a value of some Exp m where the differential of End 
is not onto. Therefore, it is a singular value of Exp m . This constitutes a measure 
zero sub-analytic subset of G. 

□ 


Remark 6.1. In the free 3-step Carnot group, we are not able to bound the codimen¬ 
sion of Abn /m (e) away from 1. However, the codimension of Abn^(e) is at least 3. 
Actually, in the free 3-step rank-r group F r) 3 this codimension is greater or equal than 
r 2 — r + 1. The calculation is similar to the one in Section [Tol Indeed, by the Witt 
Formula (see [Bou981 p.140-142]) the dimension of F r 3 is 


( 6 . 2 ) 


dim F r , 3 = r + 


r(r - 1) 


+ 


*3 

ry* _ ry* 


In the proof of Theorem 11.51 we showed that each abnormal geodesic from the origin 
is in a subgroup, which therefore has codimension bounded by dimF r _i )3 , computable 
via the Witt Formula ( 16.2[) . The collection of all the subgroups of rank r — 1 can be 
parametrized via the Grassmannian Gr(r, r— 1), which has dimension r —1. Therefore, 
we compute 


dim F r , 3 — dim F r _i i3 — dim Gr(r, r — 1) = r 2 — r + 1. 

Notice that r 2 — r + 1 equals 3 if r = 2, and is strictly greater than 7 if r > 3. 


6.2. Investigations in the rank-3 case. As said in Section[5l the group GL(V) acts 
on each strata V 3 of the free algebra f ri00 . So each summand V 3 breaks up into GL(V ) 
irreducibles. Also, the fc-step rank r Lie algebra decomposes as a representation space 

fr,k — V © V2 © ... © Vfe. 

The first summand V is the ‘birthday representation’ of GL(V). The second summand 
is well-known as a GL(V) representation, and in any case is easy to guess: 

U 2 = A 2 V 

with the Lie bracket V x V —>■ A 2 V being [v,w] — v Aw. The third summand is 
less well-known and will be treated momentarily. First a few more generalities. Any 
algebra becomes a Lie algebra when we define the Lie bracket between two elements to 
be their commutator. So the full tensor algebra X(U) = V © V® 2 © U® 3 ©... inherits 
a Lie algebra structure. Under this bracket we have [u, w] = v ® w — w ® v = v Aw 
for v,w € V. The free Lie algebra over V is the Lie subalgebra that is Lie-generated 
by V within the full tensor algebra T(U). In particular, 

V r C U®L 

Both the symmetric group S r on r letters, and the general linear group GL(V ) acts on 
V® r . By Schur-Weyl duality, see |FH911 Exercise 6.30 page 87], under the joint action 
of GL(V) x S r the space V® r breaks up completely into irreducibles and this represen¬ 
tation is “multiplicity free”: each irreducible occurs at most once. The irreducibles 
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themselves are written in the form S\(V) 0 Specht(A). Here A is a partition of r and 
is represented by a Young Tableaux with blank boxes. Then S\(V) is the irreducible 
representation of GL(V ) corresponding to A, whereas Specht(A) is the irreducible 
representation of S r corresponding to this A. If we are only interested in decomposing 
V® r into GL(F)-irreducibles, what this means is that each irreducible S\{V) occurs 
dim(Specht(A)) times. For example, the representation S r (V ) of symmetric powers 
of V corresponds to the partition r = l + l + l + ... + l. The representation A r (F) 
corresponds to the partition r = r. 

To the case at hand, V 3 C F ® 3 corresponds to the partition 3 = 2 + 1. This 
representation is dealt with in fine detail in |FH9ll pages 75-76]. We summarize the 
results within our context. The bracket map V 0 A 2 F —>■ V 3 which sends 
\u,uj] = r®w-u®ris onto, but as soon as dim(V) > 2 it is not injective due to 
the Jacobi identity. We want to describe the image V 3 of the bracket map. There 
is a canonical inclusion i : V 0 A 2 F —> F® 3 , namely the identity !) 0 om-mj 0 u, 
whose image contains V 3 . To cut V 0 A 2 F C F ® 3 down to V 3 we must add linear 
conditions which encode the Jacobi identity. Consider the canonical projection map 
f3 : F ® 3 —* A 3 !/ which sends v\ 0 v 2 0 v 3 to v\ A v 2 A v 3 . Then the Jacobi identity is 
(3 = 0, so that V 3 = im(i) D ker(/3). 

Let us now go to the specific case of 011111 ( 1 /) = 3. Here dim(F 0 A 2 !/) = 3x3 = 9, 
whereas dim(l/j) = 8 . In this case the Jacobi identity is ‘one-dimensional’. We 
show how to identify V 3 with sl( 3) by hxing a volume form 011 V. Write coordinates 
x,y,z — Xi,X 2 , x 3 on V and take as the resulting volume form y = dx 1 A dx 2 A dx 3 . 
The choice of form both singles out SL( 3) C GL( 3) = GL(V) and yields a canonical 
identification A 2 H = V* by sending v Aw to the one-form y(v, w, •). Thus V 0 A 2 !/ = 
V 0 V* = g[(H) as an SL( 3) representation space, with SL( 3) = SL(V) acting by 
conjugation on gl(H). For example, dj 0 {d\ A 82 ) is sent to the element d 3 0 dx 3 
under this identihcation. One verifies that the kernel of (3 is equal to the span of the 
identity element 7 = ^0 dx\ + d 2 0 dx 2 + 9 3 0 dx 3 under this identihcation. Thus 
V 3 = g((l/)/MJ. Next, observe that as an SL(V) (or GL(V)) representation space we 
have: V 0 V* = sl(V) 0 M/ where sl(V) consists of those matrices with trace zero. 
Thus V 3 = gl(l/)/M/ = sl(V), as SL(V) representation spaces. Notice that as GL(V) 
representation spaces this equality does not hold since the element XI G GL(V) 
acts on V 3 by A 3 /, while under conjugation the same element acts on sl(V) as the 
identity. An investigation of what ad^ looks like in relation to this SX(3)-equivariant 
decomposition led to the specific element £ defined at the end of Section 15.11 

To get to the equations describing abnormality for F 3>3) we write its Lie algebra as 

j+3 = Vi © V 2 © V3 = M 3 © R 3 * © s((3) 
and so an element of the dual Lie algebra can be written out as 

A = (A 1; A 2 , A 3 ) G f ^ 3 = FT © V* © F 3 * = R 3 * © R 3 © jel(3)*. 

For this covector to lie along an abnormal extremal it must be Ai = 0. 
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We partition the abnormal extremals into two classes: those for which A 2 7 ^ 0, 
which we call regular abnormal extremals following Liu-Sussmann, and those for which 
A 2 = 0. The Hamiltonian 

H = P,P 23 + -P 2 P 3 i + P3P12 
generates all the regular abnormal extremals. Here 

A 1 = (P ll P 2 ,P 3 ) 

A 2 = {P'Xh P 3 I) Pl 2 )- 

and 

Pi — P Xi Pij — Pxij = —Pji 

where we are following the notation of (12.201) and (15.ip . When we say that PI “gener¬ 
ates” the regular abnormal extremals we mean two things: (A) the Hamiltonian flow 
of H preserves the locus Ai = 0, i.e., the locus = {P 3 = P 2 = P 3 = 0} and (B) on 
the locus Ai = 0, A 2 7 ^ 0, a unique - up to reparameterization - abnormal extremal 
passes through every point, with the extremal through ( 0 , A 2 ,A 3 ) being the solution 
to Hamilton’s equations for this Hamiltionian H with initial conditions A. 

We follow a Hamiltonian trick that Igor Zelenko kindly showed us for both finding 
p[ and for validating claims (A) and (B). Start with the Maximum Principle charac¬ 
terization of abnormal extremals discussed in Section l2~4l According to this principle, 
an abnormal with control u(t) is a solution to Hamilton’s equations having the time 
dependent Hamiltonian H u = u 3 P\ + u 2 P 2 + u 3 P 3 and lying in the common level set 
Pi = 0, P 2 = 0, P 3 = 0. From Hamilton’s equations we find that 

P\ — {Pi; Hu} = —u 2 P\ 2 — M 3 P 13 

P 2 = {P 2 , H u } = U \P 2 \ - W 3 P 23 
P 3 = (P 3 , H u } = 11 1 Pji - u 2 P 32 

But we must have that P t = 0. Consequently (ui,u 2 ,u 3 ) must lie in the kernel of the 
skew-symmetric matrix whose entries are P^. As long as this matrix is not identically 
zero, its kernel is one-dimensional and is spanned by (P 23 , P 31 , Pi 2 )- It follows that: 

(«i, w 2 ; u 3 ) = /(P 23 , P 31 , P 12 ); / 7^ 0- 

Since the parameterization of the abnormal is immaterial, we may take / = 1. Plug¬ 
ging our expression for u back in to H u yields the form of PI above. 

We can write down the ODEs governing the regular abnormal extremals, using this 
H. We have just seen that 

u — A 2 = (P 23 ; P 31 ; P 12 ) 

describes the controls, i.e., the moving element of V. This control evolves according 
to 


u = Au 
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where A is a constant matrix in SL( 3). These are to be supplemented by the under¬ 
standing of what the resulting abnormal extremal is 

Ai = 0, A 2 = u , A 3 = A. 

We want to establish Hamilton’s equations, using this H. For doing so, we compute 
Pij = {Pij,H} and P ijk = {P ijk ,H} = 0 where P ijk = Px ijk - The first equation 
results in a bilinear pairing between P^ and Pij k which, when the Pij k are properly 
interpreted as an element A G SL( 3), is matrix multiplication. 


6.3. Computation of abnormals not lying in any subgroup. Take a diagonal- 

izable A with distinct nonzero eigenvalues a, 6, c, a + b + c = 0. For simplicity, let 
it be diag(a, 6, c) relative to our choice of coordinates for V. Then u evolves accord¬ 
ing to u(t) = (Ae at , Be bt , Ce ct ). We may suppose that none of A,B,C are zero by 
assuming that no components of A 2 = n(0) are zero. The corresponding curve in G 
passing through e = 0, projected onto the first level is the curve x x = ^(A(e at — 1), 
X 2 = \(B(e bt — 1), X 3 = A(C(e ct — 1). Since the functions 1, e at , e bt , e ct are linearly 
independent , the curve projected to the first level cannot lie in any proper subspace 
of V, which in turn implies that the entire abnormal curve cannot lie in any proper 
subgroup of G. 

Alternatively, one can directly use Corollary 12.141 In fact, with the notation of 
Section [5] one can take A = e 21 — e* n + e\ 2 — ce 213 + ^312 to prove that the curve with 
control u(t) = e bt , e ct ) is abnormal. 


The characteristic viewpoint. We put forth one further perspective on abnormal ex¬ 
tremals which makes the computation just done more transparent. Take any po¬ 
larized manifold (Q, A). Take the annihilator bundle of A, denoted C T*Q. 
Restrict the canonical symplectic form oj of T*Q to A* 1 . Call this restriction uj a- 
Then the abnormal extremals are precisely the (absolutely continuous) character¬ 
istics for wa, that is the curves in A x whose tangents are a.e. in Ker(cuA)- Let 
7 r : A x —> Q be the canonical projection. Then a linear algebra computation shows 
that d-K^x) projects Ker(a;A)((7, A) linearly isomorphically onto Ker(ta 9 (A)) C A q 
where A G A f | ha w q ( A) G A 2 A* is the operator called the “dual curvature” in 
[Mon02] . In the case of a polarized group (Q, A) = (G, V ) we have that w q (X) is the 
two-form of Equation (12.151) for A = rj G V ± . 

In our situation V has dimension 3 so that w( A) has either rank 2 or 0 and thus its 
kernel has dimension 1 or 3. The kernel has dimension 1 exactly when X 2 7 ^ 0, and 
rank 3 exactly when A 2 = 0. Along the points where A 2 p 0 the kernel of Ua is a line 
held, and the Hamiltonian vector held X# for H above rectihes this line held. Note 
that Xh vanishes exactly along the variety A 2 = 0 . 
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7. Open problems 

Is Abn(e) , the set of endpoints of abnormal extremals leaving the identity, a closed 
analytic variety in G when G is a simply connected polarized Lie group? In all 
examples computed, the answer is ‘yes’. However, even the following more basic 
questions are still open. 

Is Abn(e) closed? 

Can Abn(e) be the entire group G? 

Concerning the importance of the adjective “simply connected” above, consider the 
torus. Any integrable distribution V whose corank is 1 or greater on any space G has 
its Abn(e) the leaf through e. Consequently an irrationally oriented polarization V 
on the torus has for its Abn(e) a set that is neither closed nor analytic. 

We also wonder wether statements 5 and 6 of Theorem 11.21 can be upgraded to 
algebraic. 

Can one unify (6) and (7) having the result for all semisimple groups? 

If G and H are polarized Lie groups having the Sard Property, does any semidirect 
product G xi H have the Sard Property? 

Finally, in the particular case of rank 2 Carnot groups, what is the minimal codi¬ 
mension of Abn(e)? 
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